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Abstract. We study the Parisi functional, appearing in the Parisi formula for the pres- 
sure of the SK model, as a functional on Ruelle's Probability Cascades (RPC). Computa- 
tion techniques for the RPC formulation of the functional are developed. They are used 
to derive continuity and monotonicity properties of the functional retrieving a theorem 
of Guerra. We also detail the connection between the Aizenman-Sims-Starr variational 
principle and the Parisi formula. As a final application of the techniques, we rederive 
the Almeida-Thouless line in the spirit of Toninelli but relying on the RPC structure. 



1. Introduction 



The Sherrington-Kirkpatrick (SK) model is a mean-field spin glass system on configu- 
rations a £ {±1}^ of N spins with the Hamiltonian 

-f^Ar(o-) = ^= ^ JijaiGj + h ^ cJi. 

^ l<i<j<N l<i<N 

The couplings Jij are independent standard gaussian variables and /i G M. 

It is now a theorem that the quenched pressure of the SK model in the thermodynamic 
limit, PsxiPyh) := limiv-»oo -^-Sj [log e"^^^^*^)] , is given by the celebrated Parisi 
formula [13j : 



PsK{(3,h) 



inf|log2 + /,(0,/i)-^ [\x 
^(■) I ^ Jo 



{q)dq 



The infimum is over all increasing, right-continuous functions x : q ^ x{q) on [0, 1] such 
that x(0) = and x(l) = 1. At the heart of this formula is the so-called Parisi functional 
X >■ /a;(0, h) where fxiQ,y) is the solution to the partial differential equation 



(1) 
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djiq, y) + - d'yfiq, y) + x{q) {dyf{q, y)Y 







with the boundary condition f{l,y) = log cosh pHl [Tl| . 

A different approach in computing the pressure of the SK model was taken by Aizenman, 
Sims and Starr (^45^) In this approach, the pressure is expressed through a general 
variational principle over random overlap structures (ROSt). A ROSt is a measure ^ on 
a pair Q) where = {(,a}a£A is a set of weights labeled by A and Q = {qa,a'} is a 
positive semi-definite form on A. The variational principle uses functionals on ROSt's of 
the form 



(2) 
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log- 



where 77 is a gaussian field with covariance Q and ip is a specific function. 
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As it was pointed out in the link between the two approaches in computing the 

SK pressure is provided by a particular family of ROSt's known as the Ruelle's Probability 
Cascades (RFC). In fact, the Parisi formula is retrieved by restricting the AS"^ variational 
problem to this class of ROSt's. These ROSt's possess two important features. First, their 
overlap matrix can be represented as a tree structure, sometimes qualified as ultrametric. 
Second, these processes are stable under stochastic shift of a certain kind. This property 
shall be defined precisely and be referred to as the quasi- stationarity property. 

The goal of this paper is to exhibit specific techniques for spin glass computations with 
the RFC's. The RFC is a natural setting to study the Farisi functional and its properties 
and to perform computations relevant to the SK model. 

The paper is organized as follows. We first introduce the RFC. We then precisely define 
the quasi-stationarity property and give sufficient and necessary conditions on the stochas- 
tic shift for stability. We proceed by studying functionals on RFC's of the form ^ that 
reduce to Farisi-like functionals. We derive differentiation formulas for these functionals 
which naturally lead to continuity and monotonicity properties thereby retrieving a theo- 
rem of Guerra for the Farisi functional. Finally, we detail the connection between the 
AS'^ variational principle restricted to the class of RFC's and the Farisi formula for the 
pressure of the SK model. As an example of computation for this variational principle, 
we prove the instability of the high-temperature solution above the Almeida-Thouless line 
following the idea of Toninelli but using the properties of the RFC functionals intro- 
duced earlier. It must be emphasized that the key element involved in most calculations 
is the quasi-stationarity property of the RFC. 

The connection between the RFC's and the SK model is still to be fully understood. 
In particular, the question of whether or not the overlap distribution of the SK model is 
supported on ultrametric matrices is open. The quasi-stationarity property of the RFC 
seems to be at the core of this question as pointed out in ISHHIIZI- 

The author is thankful to Michael Aizenman for introducing him to the subject and for 
plenty of insightful discussions. 

2. Ruelle's Frobability Cascades 

Ruelle's Probability Cascades, or RFC's, are cascades of Foisson point processes which 
carry a natural hierarchal distance between the atoms of the cascade. The RFC was for- 
mulated by Ruelle based on the Ceneralized Random Energy Model (GREM) originally 
defined by Derrida as a limit of finite point processes 0. Ruelle's formulation extends 
GREM's to allow continuous branchings or hierarchies In these notes, we are inter- 
ested in the case of finite number of branching levels where the definitions of GREM and 
RFC correspond. Keeping this in mind, we will often use the word GREM for an RFC 
with a finite number of branching levels. 

2.1. Probability Measures on [0, 1]. We start by fixing the notation that will be needed 
in the definition of the GREM and used throughout the paper. 

Let M be the set of probability measures on [0, 1] and A^a C A4, the subset of atomic 
measures with finite number of atoms. For later purposes, we also introduce the 
subspace of ^Aa with exactly A;-|- 1 < oo atoms, one of them located at 1 and the remaining 
located on [0, 1). We write M^^ for (JfcgN-^afc- 

The space M.^\ corresponds to the following subspace of [0, 1]'^+^ x [0, 1]'^+^ most com- 
monly used in the spin glass literature. We associate to x G ■^aX P^^'- ^) '^here 
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X = {xi,i = 1, .., k + 1) and q = {qi, i = 1, .., k + 1) with the constraints 

< Xi < X2 < ... < Xfc+l = 1 

< qi < q2 < ... < qk+i = 1. 

We also set qo = 0. In this notation, refers to the position of the i-th atom and 
Xi = x{qi). 

Throughout these notes, we will identify a probability measure with its distribution 
function and write x ^ M for a distribution function x of a measure in M. We will be 
naturally led to endow Ai with the topology induced by the i^([0, 1], g' {q)dq)-iioim. on the 
distribution functions for a given smooth function g. It turns out that the topology does 
not actually depend on g. We refer to this topology as the L^-topology on A^. In fact, 
the L^-topology is simply the weak topology on M. (see Appendix for details). Note 
that the subset is dense in M. in the L^-topology. 

2.2. The REM. The building block of the cascade of the GREM is the simple REM 
point process. 

Definition (REM). Let < x < 1. A REM(x) is a Poisson point process on M+ with 
intensity measure xs^~^ds. 

The value of the parameter x = 1 is evidently singular. It will become clear later that 
this is the fundamental reason for introducing the subspace A^^ ^ C Ma- Fortunately, we 
will later consider functionals of the point process that allow a continuous extension to 
the case x = 1. 

Let ( = {Ca} be a REM(x). It is not too hard to show that Ca < oo a.s. (see e.g. 
|llj). In particular, C is locally finite on (0, oo) and bounded on the right almost surely. 
Therefore, it is possible to enumerate the points of a realization in decreasing order i.e. 

Ci > C2 > .... 

It turns out that the REM possesses an interesting stability property under stochastic 
shift. This property is at the root of the techniques and results presented in this paper. 
Let C be a REM(x). We consider a random variable W on M"*" with distribution such 
that E^[W^] = w^di'{w) < 00. A proof of the following can be found in Proposition 

3.1 of ini- 

Proposition 1 (Quasi-Stationarity of the REM). Let C, = {CjIign be a REM(x) and W 
he as above. Consider {Wi}i^^ iid W -distributed and independent of Q. Define the point 
process Q := {Ci^ijieN. The following hold 

(1) Quasi-Stationarity: ^ is a REM(x) scaled by Ep\W^'Y^^ , i.e. 

l = E^[W'']^l''C- 

(2) Backward Shift: Let {Qj} he ordered in decreasing order. Let vr : N — > N 6e the 
random permutation induced by the random shift, i.e. 7r(i) = j iif Q = C,i^i- 
Then, {W^-i(^j-^}j^n are iid and independent of Q with distribution 

w^di'{w) 
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2.3. The GREM. We now construct the GREM process as a cascade or hierarchy of 

REM's. We start by defining the point process associated to a GREM, we then introduce 
the overlap matrix induced by the cascade. We choose to identify the class of GREM 
processes with the space of atomic measures A^^^. Therefore, elements of the class of 
GREM's arc distinguished by the choice of x^'s but also by the choice of overlap parameters 
g;'s. This is a useful identification as functionals over GREM's become functionals on a 
dense subspace of the space Ai of probability measures on [0, 1]. 

Let X G ■M'^l. with atoms at {qi}i<i<k+i and x{qi) = xi. Recall that Qk+i = 1 and 
Xk+i = 1. Consider a € N^, a = {ai, a^). It is convenient to define, for / = 0, k, the 
truncation a{l) := (ai, a;). By convention, a{0) = 0. Consider for each / = l,...,k a 
collection of independent REM(x;) indexed by a{l — 1) G N''~^ 

(C°^'-i),a(/-l) gN'-i) . 

The notation (C"*^'"^^) • will designate the j-th point of a realization of the process (^"('-i). 
By the convention a(0) = 0, there is only one process in the collection I = 1. 

We define recursively a hierarchy of point processes {CQ(i)}a(OeN' at levels < I < k as 
follows: ^„(o) := 1 and ^^(l) ■= Ca{l-i) (C"^'"^'')^^, • The resulting point process is then 

:= Ca(fc-l) (C"^*^~^M • 

To keep track on the branching information, it is useful to consider the filtration JT^ = 
{J^, <l < k) with J^Q being the trivial cr-algebra and = a {{^a{l')} a{i')eW > ^ ^' ^ ^) • 
Here, (t(-) designates the c- algebra generated by the collection of variables therein. 
The overlap matrix of the cascade Q = {qa,a'} a,a' e^'' defined as 

Q.a,a' '■= max{q';+i : for I such that a{l) = a'{l)}. 

The overlap matrix is clearly symmetric. Also, if a(l) 7^ Q;'(l), then qa,a' = Qi and 
Qa,a = Qk+i = 1- In addition, the following inequality holds by definition 

(3) qa,a' > min{gc«,a";9a',a"} 

for any triplet a, a', a". For da,a' := 1 — qa,a'i the inequality becomes the ultrametric 
inequality: da,a' < ^Six{da,a",da',a"}- It implies that at least two overlaps in the triplet 
must be the same, and the distinct one, if any, must be greater than the redundant overlap. 
As we will see later in the construction of the cavity field, the overlap matrix is also the 
covariance matrix of a gaussian field labeled by a G N'^. In particular, it is positive definite. 

Definition (GREM). Let x G M-a^ with atoms at {qi}i<i<k and qk+i = 1 with x(qi) = xi 
and x{qk+i) = 1. A GREM(x) is the pair {^,Q) where ^ = {^a}aeN'' resulting 
point process constructed above with parameters xi, 1 < I < k, and Q = {qa,a'} ihe 
corresponding symmetric, positive definite matrix with q^^a' € {qi, ■■■,qk, !}■ Note that, by 
definition, a GREM(x) is a ROSt. 

We stress that the letter ^ will be used for the resulting process ^ = {^alaeN'' and not 
for the whole cascade of processes. In particular, ^ does not contain information on the 
hierarchy. The information on the hierarchy is encoded in the labeling a and expressed 
through the overlap matrix Q. 

The point process ^ = {^ajag^fe keeps some regularity features of the REM. Indeed, 
Ylia ?a < 00 a.s. and ^ is a random Poisson process whose intensity measure, conditioned on 
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is X]Q,(fc_i)gNfc-i Ca'lk-i)^>'^^'° These facts are consequences of basic properties 
of the REM. Proofs can be found in Lemma 2.1. 

As for the REM, the summabihty allows the enumeration of the points of a realization 
in decreasing order, i.e. {CajaeNfe = {CijieN, (,i > £,2 > ■■■■ This ordering induces a random 
bijection : N ^ N'^ where 4>{i) = a if ^q, = ^j. The matrix (p'^ o Q o (j) = {q^(^i)^(^j)}ij£n 
is now clearly random. We will sometimes abuse notation and write qij for q,j){i),j)(^j) and 
Q for (()~^ o Qo (j). The intended meaning will be clear from the notation and the context. 
The distribution of the matrix c/)"^ o Q o looks intricate at first due to its dependence 
on the ordering of the process ^. It turns out it has a simple form due to Bolthausen and 
Sznitman 

To illustrate this distribution, we must define the following random equivalence relations 
on N for each level I, < I < k: 

(4) i j if and only if [</.(i)](/) = [0(j)](O- 

By convention, i ~o 3 for all i,j E N. We write for the partition of N induced by ~/, 
i.e. ■= N/ is obtained by lumping equivalence classes of ^xi+i- This is because 

i ~/ j if i ~z+i j by the definition The distribution of the sequence of partitions {T^i} 
is surprisingly simple. 

Theorem 2 (Theorems 1.2, 2.2 and Proposition 1.4 in Define T{t) := T^^t. The 
process T{t), t = 0, — log Xj^, — log xi < 00, is a discrete-time Markov process on the 
space of partitions of N whose transition probabilities are defined as follows. 

Consider T^'^''\s) and T^"'\t), sets of equivalence classes of {l,....,n}. Define kg = 
|r("')(s)| and kt = |r(")(t)|. Let T^^\t) be obtained from r(")(s) by respectively lumping 
mi,..., rrik^ classes ofT^"\s). Then the transition probability from T^"^^ (s) toT^^\t), s <t, 
is 

P{s - i;r(")(.),r(«)(t)) = (^^j -^uimue-'/e-^) 

where ii(l, x) = 1 and u{m, x) = ^^~^(^liy^~^^ ■ 

Moreover, the process T(t) is independent from the normalized point process {^j / Ci}«eN ■ 

Given a realization of the equivalence relations the overlap of the i-th and j-th 
points follows from equation Q: 

Qij '■= Q<t>{i)(f>{j) = 9max{«+l: i ~i j} 

Clearly, the distribution of the process Q = {qij} on symmetric, positive definite matrices 
depends uniquely on the distribution of the random equivalence classes given above. As an 
example of calculation of overlap probabilities using Theorem]^ we have Pa;('7i2 = qi) = 
{xi — xi-i). It is important to note that the last assertion of Theorem [3 implies that the 
process Q is independent from the normalized weights {^i/ J2i^i}ie^- 

2.4. The Cavity Field of the GREM. In this section, we introduce the gaussian fields 
on the GREM that will appear in the definition of the functionals of interest on RPC's. 

Definition (Gaussian Field on the GREM). Let (^, Q) be a GREM(x) and g : [0, 1] M+, 

a strictly increasing function in C^([0, 1]) with g{0) = 0. ^ gaussian field with covariance 
function g on ^ is a centered gaussian process tt = {Ka{r),a G < r < 1) with 
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covariance 

Cov{na{q),i^a'{q')) = / g'ir)dr = g{q Aq' AQa^a')- 

Jo 

In the case g{q) = q, the field is called the cavity field of ^ and will he denoted by r]. We 
will write Ki for the field of the i-th point of the configuration. 

The cavity field r/ can be constructed explicitly. We consider, for each a{l) G and 
each Q < I < k, independent standard brownian motions -Bq,(/) on [qi^qij^i). One could 
think of the brownian motion as attached to each subbranch a{l) of the cascade. For each 
a G N'^, we construct the process r]^ recursively. We set r]a{o){q) = -B^(o) for < g < gi 
and ria(i){q) = Va{l-i){qi) + Ba{i){q) for qi < q < qi+i. Finally, r]a{q) = Va{l){q) where 
qi < q < qi+i- It is straightforward to check that Cov{r]a{q) , rja' {q')) = q A q' A qa,a'- In 
particular, Cov{rja{l),r]a' {!)) = qa,a' which shows that the overlap matrix Q is positive 
definite as claimed before. The gaussian field k with covariance function g can now be 
written as a stochastic integral on r] 

ri 

i^a{q) = / V9'{r)dria{r). 
Jo 

The natural filtration of the cavity field on the tree is J-q = a (r/a(r), a G N^, < r < . 
It is useful to construct the filtration of a GREM(x) which keeps track of the information 
of the cascade of point processes as well as the cavity field on it. Let = {J-'q, q G [0, 1]) 
be the right-continuous filtration defined by = ^i_i(S>^q fo'^ Q ^ [q^qi+i) and for 
q = 1, = ^J^i- Note that the filtration is actually continuous at every point except 
at the points qi where branchings occur. Also, the cr-algebra J-q contains the information 
of the branchings strictly above [qi,qi+i) for q in this interval as symbolized by J'i_i- 

Definition. Throughout the rest of this paper, we will write P^, for the probability measure 
on T\ of a GREM(x) and its cavity field. will denote the expectation. 

3. The Quasi-Stationarity Property of the GREM 

The quasi-stationarity property of the REM stated in Proposition ^ induces a similar 
stability property on a cascade of REM. We now study this important feature of the 
GREM process. The stochastic shift at each point will be written as a function of the 
gaussian field on the RPC presented in the last section. We also look at the distribution 
of the field after a shift. It is modified by the reordering as it was in the REM case. 

We first need to introduce a class of function for which the stochastic shift is well-defined. 

Definition. Let C be the class of functions ip in C^(M) satisfying 

• ^' and ip" are bounded on M; 

• Ey [e'^(^)] < oo for any gaussian variable Y . 

We remark that Ey [e^'^^^^] < oo for any < x < 1 (using Jensen's inequality applied 
with the convex function f{y) = y^^^). Also, C includes the functions iP{k) = log cosh(/3K+ 
h) and tP{k) = (3k. 

In this section, we are interested in the stability properties of the GREM under the 
stochastic shift 



SPIN GLASS COMPUTATIONS AND RUELLE'S PROBABILITY CASCADES 



7 



where k is a gaussian field on ^ with covariance function g. The family of functions 
(/(?) 9 £ [0) 1]) is assumed to be contained in the class C. We also assume that the family 
is differentiable, i.e. for y fixed, fq{y) is a difFerentiable function of q. 

An example of such a family is the following. Fix x G -Ma"^- Let ^ £ C and ipi := ip. 
For q £ [qi, qi+i), we define recursively ipq as 



(5) 



V'g(y) = — log-E;^ 

Xl 



for 1 < / < A;; 



for 1 = 



where Ez denotes the expectation over z, a standard gaussian. We dropped the dependence 
of ipq on X and g but the reader must keep in mind this dependence. It is easy to verify that 
ipq is in C Moreover, by direct derivation, ^q is seen to satisfy the differential equation 
(see e.g. US]) 

with the continuity condition lim^^^- il^q{y) = ipqi+iiu)- More generally, by using the 

condition of continuity and the equation for each interval, the function ipq{y) actually 
satisfies 







with boundary condition '4>i{y) = ipiy)- 

As a matter of fact, the function e'^''^^-* is the factor £'[1/^/^']-'^/^' coming from the ap- 
plication of the quasi-stationarity property of Proposition ^ to a IlEM{xi) with a shift 
Wa = e^''^^+^"\ q < r < qi+i, where Ya are independent gaussians M{0,g{r) — g{q)). 

The family of functions ij)q has the property that the GREM distribution under their 
associated stochastic shift is invariant up to a random common factor (labeled by a(0)): 



for q G [gi, 1]. Indeed, let q G [qu qi+i]- We write (5a(/)(g) := K„(;)(g) - Ka{l){qi)- Note that 
the 6a(i)^s are independent gaussian M{0,g{q) — g{qi)) for each a{l). Therefore, we can 
apply the quasi-stationarity to each REM (^"('~^): 



V=l+l 



V 



n < 



l'=l+l 



where we used the definition of ^jJq^ in the last equality. This procedure is applied succes- 
sively up to qi to prove the claim. 

Surprisingly, it turns out that the property © characterizes the family {tpq,q G [0, 1]). 

Theorem 3 (Quasi-Stationarity of the GREM). Let {fq,q G [0,1]) be a differentiable 
family of functions inC. Let (^, Q) be a GREM(x ) and k, its gaussian field with covariance 
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function g. Then the function fq{y) satisfies the differential equation (jSJ for q £ [qi, 1] if 
and only if 

for all q,r £ [qi, 1]. In particular, 

(7) (e.e^('^"(i)),Q) 2 (^^ef.^i-.(oM))^Q] 



Proof. The sufficiency of the differential equation for stabihty was proven above. We prove 
the necessity. Pick q E [qi,qi+i), I > 1- Choose Aq small enough so that q + Aq belongs 
also to [qi,qi-i-i)- Consider (5Q,(^)(Ag) := K^(^i^{q + Aq) — K^^-^{q) that are independent 
gaussian M{0,g{q + Aq) — g{q)) for each a{l). Applying quasi-stationarity, we obtain 



o'-^lfq + Aq{l^a{q)+Sa(l){Aq)) 



But, by equation Q, we also have 

As this must hold for all realization of Ka{q), we conclude that -E's^^q 
Q^ifq{y) for all Aq. In particular, 



1 



lim -— Es ,,, 
Ag^o Aq \ 

if the limit exists. The limit does exist and is easily computed by Ito's formula 
d 



oXlfq+Aq{y+Sc(l){Aq)) 



Xlfq+Aq{y+Sa(l){Aq)) 







which yields the desired differential equation. 



= xie^^f^^y^ Um + ^{f'^{y) + x,{f'^{y))' 



□ 



From now on, we will use the notation for the shifted process 

Consider the 

random permutation vr of N induced by this random shift, i.e. 7r(i) = i' if ^j/ = S^^e^^'^^^^^^ 
As in Proposition we are interested in the backward distribution of the random shift. 
More precisely, we study the distribution of the field k: 

k := {ki,i G N) = G N). 

Proposition 4 (Backward Distribution of the field). Let /Xg ^ be the joint distribution of 
the gaussidfi fields k\j . . . jK^i ufidcT IP^ given the overlap Q and fiq' , the distribution of 
ki,...,kn under Fx given Q. Then fiq^ is absolutely continuous with respect to /ig^ and 



n n 



/=OiG{l,...,n}/^, 

where the product is over the equivalence classes o/ {!,..., n}/ ~/ and 

pXl-^qi + liMH + l)) 



^xiipq^ikiiqi)) 
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From the form of the distribution, we conclude that R, is independent from ^. The last 
proposition seems abstract at first but will prove extremely useful as it will allow us to 
express derivatives of the Parisi functional (and more generally, of functionals on RPC's) 
in a compact way as expectations over the backward gaussian field. 

Proof. We prove the case n = 1. Choose a finite set of t/s in [0, 1], j = 1, J. We consider 
the union of {tj}j<zj and {qi}i<i<k+i- {?'i}j=i,...,Af = {tj}^{qi} so ri < r2 < ... < r^- The 
claim will be proven for n = 1 if for any choice of tj , the finite-dimensional distributions 
satisfy 

/2«(^i(t,)GA„i<j< J)= / ... / n ^^^'\^lin)eds.^<i<N). 

where -Bj = Aj if = tj and Bi = M otherwise. 

Define li as the level / where € {qi,qi+i]- By definition, if rj ^ qi for any / then 
/j+i = li- The key point in the definition of the is that the k^^^.^'s, given J^n-n are 
independent. (This would not be true if one does not consider all g/'s in the definition of 
ri's.) 

By Theorem |31 we have that. 

By the quasi-stationarity property of the REM (Proposition^, the backward distribution 
of Ki(rj) given J='r^_^ is 

The joint distribution of the Ki(rj) is therefore 

/iW(^i(r,)Gi?.,l<i<iV) = ...j^ n (^^(^-^ ^ l<i<N). 

If rj 7^ for any /, we noted that /j+i = /j. Thus, the factors in the product coming from 
these terms cancel out and only the terms in qi remain. The claim is proven for n = 1. 
If n > 1, the same procedure applies. For example, one could pick where m 

indexes the points from 1 to n. Then, one considers {rj} = {qi} Uml^'"'*} as before. In this 
case, at each level /, every equivalence class z of {1, n}/ ~i picks up a Radon-Nikodym 
derivative Vi. □ 



We now state a result on the regularity of the expectations of the field R that we will 
need when studying functionals of the GREM's. We omit the proof as it is a direct 

(n) 

consequence of the fact that /ig is smooth in the parameters xis and qis. 

Corollary 5 (Expectations of the Backward Field). Let x G Consider {i,Q), a 

GREM(x), with a gaussian field k. Let Qn he an n x n matrix such that Tx{Qn) 7^ and 
define 



FQ„(x,q)=E, 



Qn 



.i=l 



where (/> : M ^ R is a hounded continuous function and q = (go, gfe) o,nd x = (xq, a^fc) 
as hefore. The following statements hold : 
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i Fq^ (x, q) is a continuous function of q; 

ii Fq^ (x, q) is continuous in xj on (xj_i, Xj+i), for all 1 < j < k. The limits liuix -^x _i Fq^ (x, q) 
and limi^j.^a;^.^^ Fq^(x, q) exists and are continuous functions of q. 

In the last claim, we stress out that the limit of Fq^^ as Xj — > xj^i is not equal to 
Fq^ evaluated at (xq, a^j-i, a^j+i, Xj+i, x^) and similarly for the limit Xj — > xj-i. 
This is basically because the distribution functions of the approximating sequence clearly 
possess one atom more than the limiting distribution function with xj = Xj+i. Therefore, 
lima^^.^a;^.^-^ Fq^ (x, q) differs from the function Fq^ evaluated at the limiting distribution 
function as the product over the number of atoms appearing in the density of k in Propo- 
sition!^ has an extra factor in the first case. 



4. The Parisi Functional as a functional on RPC's 

In this section, we establish that functionals on RPC's of the form ((2)) coincide with 
Parisi-like functionals on the space M<^. The RPC formulation is a natural framework for 
deriving properties of such functionals as one can take advantage of the rich structure of the 
GREM and of the quasi-stationarity property. This is useful as it can be sometimes tedious 
to derive properties from the solution to the differential equation As an example 
of techniques in the RPC formulation, we obtain differentiation formulas which lead to 
the continuity and the monotonicity of the functional. This result slightly generalizes a 
theorem of Guerra Using continuity, we also exhibit a limit form of the RPC functional 
in the singular case x £ Aia but x ^ -M^ ^• 

4.1. The Parisi Functional. We first define the Parisi functional in a general way. The 
reader can consult |IQ| for particular choices of settings. 

Definition. Let ip £ C and g £ C^{[0, 1]), a strictly increasing function such that g{0) = 0. 
The Parisi functional : Aia ^ K is defined as 'P^"'g{x) := /x(0, 0) where fx{q,y) is 
the solution to the differential equation 



9'{q) 



dj{q, y) + -f^ d'yfiq, y) + x{q) {dyf{q, y))' 







with the boundary condition f{l,y) = ip{y)- The case Tp{r]) = log cosh(/3r/-|-/i) and g{q) = q 
reduces to equation 

From another perspective, the ^45^ variational principle formulation is based on func- 
tionals of the following form [H] . 

Definition. Let ip and g be as above. The functional V^^g : — > M is defined by 



(8) r^,g{x) := 



log- 



where (^, Q) is a GREM(x ) and k is a gaussian field on ^ with covariance Cov{Ka{q), i^a' (q')) 
g{q/\q' Aqa,a')- We will write Vp^h in the special case Tp{r]) = log cosh(/3r/-|-/i) and g{q) = q. 

The main result of the section is the correspondence of these functionals and the Parisi 
functionals. 

Theorem 6 (The Parisi functional on RPC's). For any x £ -Ma^, T^^gi^) = 'Pi>,gi^)- 
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Proof. The quasi-stationarity of the GREM (Theorem impUed equation (O: 
By inserting this into equation (jH)), one gets 

by definition of ipQ (equation ©)• But ipg{y) is the solution to the differential equation of 
the Parisi functional by Theorem |31 again. We conclude that V^^gix) = V^'^gix). □ 

It is worth pointing out that V^^g is linear when ^ is. 

Proposition 7 (Linearity of V^^g). If ip{r]) = (3rj, then V^^g{x) is a bounded linear func- 
tional. Precisely, V^^g{x) = ^ x{q)dg{q). 

Proof. We can write Kq(1) as a sum of independent increments: Kci(1) = X]f=o '^"(0 '^^^re 
^a{i) = i^aiQi+i) — i^aili)- We Can then apply the quasi-stationarity to each REM (^"('~^) 
of the cascade: 

^^g/5ELo^a(0 V. g/3KQ(0)(9i)^^ g^a:^!(5fe+l)-sta)) 

1=1 

where we have used the fact that the Laplace transform of a standard gaussian is e~. 
Note that the expectation of KQ,(o)(q'i) is by definition. The claim is proven by inserting 
the last equation into equation (jSJ for V^p^g. □ 

4.2. Differentiation. How does 7^^,^ vary as the position qi of an atom or the weight x{qi) 
is changed? To address this question, we look at the derivatives of 'Pip,g{x) with respect 
to the parameters xi and qi. It turns out that the j;-derivatives are simply related to the 
g-derivatives due to the structure of the space Aia- Both are expressed as expectations on 
the backward field k. For conciseness, we will use the notation Ki = Ki{l) for a gaussian 
field Ki at q = 1 throughout the section. 

Proposition 8 (g-Derivatives) . Let x G M-a^ with atoms {qi}. The following differenti- 
ation formulas hold: 

(9) dg,V^A^) = ^^E, [i^'C^l)i^'r^2)Xgr,=g,] 

where n is a gaussian field on a GREM(x) and XA is the identity function of the event A. 
If9{q)=q, 



(10) dg^dg.V^,g{x) = -^E, 



mjXqi 



'12=9i,'?34=<?j 

.m=l 



+ 2E, [v'(77i) {rim) + V'"(r/2)) i^'im)xqr 



2=91,923=9^] 



- ^s,,E^ [{rim) + rivi)) i^im) + rim)) X9i2=9j 

where r] is the cavity field of the GREM(x). In particular, both derivatives are continuous 
functions of the qi 's. 
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Proof. The continuity of the derivatives follows from the form of the expression and Corol- 
laryEl For the first derivative, we use the gaussian differentiation formula (|25j) in Appendix 
IbI The parameter is qi and the covariance is Kx[Ka{l)Ka'{l)] = Yl^=i 9{^l)^qa a'^ii where 
^q,q' = 1 if g = and otherwise. Therefore ^q^E,x[^^a{l)^^a'{^)\ = 9' {li)^q^ ^i=qi 
/ = 1, k. Note that the first term of formula (|25|) vanishes as q^^a = 1 all a. Thus, 
the first derivative becomes 



dqiV^,g{x) 



-9'{qi) 



Ea,Q' Ido.'i^' {l^aW {l<'a')5q 



where we have used the notation = S,ae'^^'^°'^^^^ ■ After ordering the we can write by 
the definition of k 



Conditioning on ^ and qij, bearing in mind the independence of k and ^ from Proposition 
HJ one can write the expectation in the r.h.s. as 



Ex. [V''(^l)V''('^2)kl2 = 



qij,qi 



where we have used the fact that the joint distribution of Kj and kj is the same as the 
distribution of ki and K2 for all i,j. The proof is completed by first recalling that the 
shifted normalized process is distributed as the original normalized process by 

the quasi-stationarity property. Moreover, the normalized process is independent of the 
overlap matrix {qij} as it was remarked in Theorem El Therefore, the second expectation 
above simply b ecomes IPx(^i2 — ^/) by conditioning on the normalized weights and by 
noticing that fxiqij = qi) does not depend on i^j for i ^ j. This yields equation Q. 

The second expression is obtained from formula (|26|) in Appendix El with (/>(k) = 
log X^a ^a^'^'''^"^ straightforward derivation. □ 

Obviously, a formula holds also for a more general g in the case of the second derivatives. 
We omit it for the sake of conciseness. 

The nice feature of the above derivative formulas is that they explicitly express the 
derivatives of the Parisi functional in terms of expectations over the field H and probabil- 
ities on the GREM cascade. Using conditional expectations, we may rewrite the second 
derivative formula, e.g. in the case ip{z) = log cosh(/?2: + /i) where the identity ip" + tp''^ = 1 
holds, as 



(11) 

9qidq.rf3^hix) 



-(3' Px.(Q4(ft,</,))IE. 



.m=l 



2(5^ Fx{Q3{qi,qj))^x[tanh{f3f]i + h)tanh{(3fi2 + h)\Q3{quqj)] 

Q3(gi,qj) 

^(3^6^jFx{qi2 = qi). 
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where the sums are over ah 3 x 3 and 4x4 matrices and such that qi2 = qi, (?23 = Qj 
and qi2 = qi,q3A = qj with fx{Q3{qi,qj)) / and ^x{QA{qi,qj)) / 0. Note in particular 
that these matrices must satisfy the inequahty ©• 



Corollary 9 (Useful estimate on the g-derivatives). Let x G A4'^ with i-th atom at 
LetC>0 be such that {ip'l < C. Then 

(12) < -dg^n^^gix) < —{x, - x,^i)g'{q,). 



if 



Proof. The upper bound is clear from equation Q, the assumption on tp and the fact that 
^x{qi2 = qi) = Xi — Xi-i. The lower bound is a consequence of 



4'' {m)^}' {7)2, 



qi2 



Ex [E,[V^'(r/i)|^,, 



□ 



The structure of the space Aia enables us to relate the x-derivatives and the g-derivatives 
through a simple differentiation scheme. To do so, we need to define the measure obtained 
from X € Ma by transporting a mass 6 from an atom at qi to s £ [0, 1]. 

Definition. Let x € Ma- Let qi he the position of the i-th atom of x, i < k. Consider 
5 > and s G [0, 1]. We define xs^q^^s S Aia as the atomic measure obtained from x by 
transporting a mass 6 from qi to s. Note that if s = qj for some j, then xs^q.^s has k 
atoms; otherwise, xs^q^-^s has k + 1 atoms. 

Proposition 10 (x-Derivatives). Consider x £ Ai^^ . Then 



(13) 



dx,V^,g{x) 



lim E, 



In particular, if {tp'l <C for some C > 



^'(^i)v^'(K2: 



912 



dg{r). 



< dxiV^,g{x) < —{g{qi+i) - g{qi)). 



Proof. The upper and lower bounds are obtained as in Corollary [21 followed by integration. 
For the sake of clarity, we set x^ = x^^q^^^-^r throughout the proof. By Proposition |H1 



r' tp,g\Xs) 



^\9'{r)Ex, 



.m=l 



qi2 



Here we have used P^^ {qu 



•) = xs{r)—xs{qi) = 5. The r.h.s. of the above equation satis- 
fies the fundamental theorem of calculus as a function of r as g'{r) and E^;^ Y\l=i i^'i^i) qi2 - 
are continuous functions of r by definition and Corollary [3 respectively. Moreover, the 
limit lim^^o \drV^^g{xs) exists and is bounded thanks to LemmaEl 



lim -drV^^g{xs) 
0— >o 



— q'ir) lim E^, 



.m=l 



qi2 
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The fundamental theorem of calculus and the above limit yield the desired expression for 
the right-derivative d^V^^g{x): 

„. <5^0 5 

HI 

The equality of left and right derivatives is checked using the fact that lim^^o 2^(5,gi+i^r = 
lim^^o ^(5,(ji^r and the x-continuity in Corollary |S1 □ 

The simplicity of the differentiation scheme gives a formal approach for computing 
derivatives of all orders in x for RPC's functionals. 

4.3. Continuity and Monotonicity. As a direct application of the differentiation for- 
mulas, we establish the L^-continuity and the monotonicity of "P^^g- This is a theorem 
due to Guerra ^6 that we prove in a general setting. 

The space M has a natural partial ordering. We say that x & M dominates y G if 
x{q) > y{q) for all q G [0, 1]. The terminology refers to the stochastic dominance of the 
random variables associated to the distribution functions. A functional A : ^ M is said 
to be monotone increasing with respect to this partial ordering if for any x,y £ M such 
that X dominates y, A(x) > A(y). 

We start by stating a useful lemma whose proof is straightforward. 

Lemma 11. Let x,y £ Ma and A : M-a —>■ IR- Suppose d^^A exists for all x G M-a- 
Suppose also that the estimate < 9^.. A(x) < CA{g{qi+i) — g{qi)) holds for some C\ > 
and for a strictly increasing function g G C"'^([0, 1]) such that g{0) = 0. Then 

(14) A(x) - A{y) <Ca [ max{x{q) - y{q),0}dg{q). 



The theorem of Guerra appeared in [gj without proofs. A proof can be found in ^ 
In the RPC formulation, it is a basic consequence of the bound on the x-derivative. 

Theorem 12 (Continuity and Mononicity). Let ip £ C such that \^'\ < C and g G 
Ci([0, 1]), a strictly increasing function with g{0) = 0. Then the following holds: 

(1) Ifx,yeMf' 



(J2 

IV^A^) - 'Pi',giy)\ < ^11^ - y\\LHg'{q)dq)- 

In particular, V^^g has a continuous extension to the whole set M. in the L^- 
topology (and so in the weak topology). 
(2) V^^g is monotone increasing on M. 

Proof. The bounds of Proposition ^1 satisfy the assumptions of Lemma ITTl The estimate 
of the first claim follows from equation (|14|) . The L^-continuity is clear from the estimate. 
The continuous extension is possible as Ai^^ is dense subset of M on the L^-topology. 
The monotonicity is proven by Lemma [TTl and the fact that if x,y G A4a and x{q) > y{q) 
for every q G [0,1], then max{0, y(g) — x{q)} = 0. The property is extended to M. by 
continuity. □ 
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4.4. The singular case x = 1. When introducing the REM, we noticed that the case 
X = 1 was singular as far as the intensity measure is concerned. However, it is necessary 
in the SK model theory to consider functionals on GREM's whose last level of splitting 
consist formally of REM(l). These GREM's correspond to elements of Aia not in Aia^- 
Using L^-continuity, we are able to obtain an expression for V-^p^g and its differentiation 
formulas ©, (CHI) and (O evaluated at these singular GREM's. 

Let X £ M-a with k atoms at {qi} and < 1. Then x ^ -M-a^- Consider x'^ £ -^a^ 
with x'^{qi) = x{qi) for 1 < / < /c, x'^{qk) = 1 — e and x'^{qk+i) = 1. Clearly, x*^ — > x 
in L^{g' {q)dq) as e goes to 0. Applying quasi-stationarity to a REM(1 — e) with shift 



, we pick up the factor Ea;^ [e^"^ ''^^^'^°'^'^'^^\J'qj^ which simply becomes in the 
limit: E^^e [e'^^^^^^^^l^gfe] =: e'^''k^'^°'ik-i)(qk)) _ One applies L^-continuity and the dominated 
convergence theorem to 'P^^g{x'^) to get 



V^Ax)=W.^ 



log- 



Yl,a{k-l) ia(k~l) 

The cases '0(^) = logcosh(/3ry + h) and V'(^) = I^V are again special as 



3V'<7fc{Kc«(fc-i)(gfe)) ._ ^ 



pV'(2\/9{i)-9{i?fc)+KQ(fc-i)(gfc)) 



g^{9(l)-9('?))gV'(KQ(fc-i)(9fc)) 



and ij) is retrieved after integration. In these cases. 



(15) V^^g{x) = ^{g{l)-g{q))+W.^ 



log- 



a(fc-l) 



fe)) 



Haik-l) ia{k-l) 

In particular, if = 1, i.e. x has a single atom sitting at q: 
(16) 



0' 



0' 



nA^) = ^{g{i)-g{q))+^. [H^amiq))] = ^{g{i)-g{q)) + 



which, not surprisingly, resembles the high-temperature solution of the SK model. 

The derivative formulas ©, (|1()|) and (fTH|) are retrieved by applying the derivative to 
the expression (|15|) . The formulas hold by replacing Kj(l) by ki{qk)- As an example, we 
compute dq^Vi3,hix): 



(17) 



^ -g'{qk)Y+9'iQk)Y^. [(/' + V'")(^i(gfe))] 
5'(gfe)yE^ [^p'{fil{qk))'>p'(k2{qk))Xql2=gk\ 

■ -g'{qk)Y^x [ii^'fif^iiqk))xqi2=qk] 



where we used the differentiation formula H25() in the first equality and the identity ip" + 
■0'^ = 1 in the second. 

5. The ^S'^-Variational Principle and the Parisi Formula 

The AS'^ variational principle expresses the pressure of the SK model in the thermody- 
namic limit PsK{(3,h) as an optimization problem over random overlap structures [21 E]: 



(18) 



PsKW,h)= lim inf GM{f3,h,i2) 

M^oo ill ROSt} 
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where fj, is the probabihty measure of a ROSt Q). The functional Gm is given by 



GM{P,h,ij) := — 



log 



where r;* and k*, i = 1, M, are independent copies of the cavity field and of a gaussian 
field with covariance function q'^/2. 

As we noticed previously, the RPC's form a particularly interesting class of ROSt's due 
to the ultrametric structure of the overlap matrix and the quasi-stationarity property. In 
this section, we study the AS'^ variational principle ()18|1 restricted to the class of RPC's. 
First, we show that the restricted variational problem reduces to the Parisi formula. Then, 
we rederive the Almeida-Thouless line which yields sufficient condition for the minimizer 
of the variational problem not to be a single atom. For this, we follow the idea of Toninelli 
but we explicitly use the RPC structure underlying the functionals. 

5.1. The Parisi Formula. The Parisi formula for the pressure of the SK model was 
proven by Talagrand in jl3j . 

Theorem 13 (The Parisi Formula). 

PsK{f3,h)= inf /log2 + 7'^X(x)-^ 

It is remarked in [21 01 that the Parisi formula is exactly the AS'^ variational problem 
restricted to the class of RPC's. To establish this connection, we start by noting that the 
limit M ^ oo in equation (|18() is no longer needed when we deal with RPC's. 

Proposition 14 (Variational Principle over the class of GREM's). Let fi be a GREM 

parametrized by x ^ -^a^- Then, for any M G N, GM{/3,h, ^) = Gi{f3, h, ^) and 



log 



E»g«2cosh(/?77^(l) + /i) 



Ex 



log' 



The variational problem of equation ()18|) restricted to GREM's reduces to 



lim inf GMil3,h, u) 

M^oo {n GREM} 



inf Gf3^h{x). 
xeMa 



Proof. It suffices to note that each of the M independent copy of the fields contributes 
the same factor to the pressure. This is done using equation Q. □ 

Note that Gj3^h{x) is the difference of two RPC functionals with '0(^) = logcosh(/?r; + /i), 
9{q) = 9 s-iid iI){k) = 13k, g{q) = /2 respectively. The Parisi formula is retrieved from 
the AS"^ variational principle on RPC's by using Theorem IHl and Proposition [3 for these 
two functionals: 

Proposition 15 (The Parisi Formula with RPC's). 

(19) PsK{(i,h)= inf Gp,h{x). 

GREM(x) 

As Gp^h is the difference of two L^-continuous functionals by Theorem 1121 it is itself 
L^-continuous and can be extended continuously to M.. Therefore we can rewrite equation 
(P|) as 

(20) PsK{P,h) = uAnGp^h{x) 



SPIN GLASS COMPUTATIONS AND RUELLE'S PROBABILITY CASCADES 



17 



because is compact in the L^-topology (recall that the L^-topology is equivalent to the 
weak topology. See AppendixE}- The question of the uniqueness of the minimizer of the 
Parisi formula was raised in jlO[ I14j but remains open. 

5.2. An example of calculation: The Almeida-Thouless Line. It is now well known 
that the minimizer of the variational principle H2U|) for the SK model is an atomic measure 
with a single atom when /3, as a function of h, is small enough ^|^. This is referred to as 
the high-temperature solution of the SK model. Moreover, it was proven by Toninelli that 
this solution cannot hold beyond the so-called Almeida-Thouless line P^i . In this section, 
we rederive this sufficient condition following Toninelli in spirit, but relying heavily on 
the RPC structure. In doing so, we hope to illustrate the convenient features of the RFC 
formalism^. 

First, we remark that the stationarity conditions of the optimization problem H2U|) 
dqfip^h{x) = for z = 0, 1, k yield self-consistency equations: 

E^. [tanh(/??7i(l) + h) twh{(3m{l) + h)\qi2 = qi] = Qi- 

This is a consequence of the definition of Gp^ and Proposition |H1 In the case of a single 
atom, we get the self-consistency equation for the high-temperature solution from equation 

m 

[tanh2(/3z^ + h)] = q. 

We denote a solution to the self-consistency equation q = g(/3, h). This solution is unique 
in the case /? < 1 and h = and in the case /i 7^ (see e.g. jS]). 

Fix P > and /i G M. The high-temperature solution corresponds to the infimum of 
Gf3,h over the subset of Ma consisting of measures with a single atom. Note that this 
set is compact so the infimum is attained. Let x* = x*(/5, h) be the minimizer. The only 
atom of X* must be located at q, the solution to the self-consistency equation. The idea 
for deriving the the Almeida-Thouless condition is to show that, if (3 and h are such that 

/ ^^cosh-^(/3z^+/i) > 1, 
Jr v27r 

then there exists an element of Aia with two atoms such that G/3,/i evaluated at that 
element is smaller than Gf^^hix*)- This implies that the high-temperature solution cannot 
hold for the optimization problem (|2n|) in this region of the plane (/?, h). 

Let us construct such an element. Pick < m < 1 and g < r < 1. Let be the 
atomic measures with atoms at q and r with x^^(^) = m and x%^j.{r) = 1. Note that 
Xm,q = X* . As Gfs^h^x'^^j.) coutinuously differentiable in m on < m < 1 for r > g, we 
have 

(21) GfS^hix*) = Gp^h{x*m,T) + / dm'Gp^h{x*m',Mm' . 

J m 

From equation (PT|) . we see that Gp^hix*^ .^.) < Gp^h{x*) if r and m are such that 

(22) dm'Gp,h{xl,,^,) > 



It was recently proven by Guerra that the high-temperature solution actually holds up to the Almeida- 
Thouless line. This had been rigorously established only in the case /i = 
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for m < m' < 1. To get this inequality, we follow 15_ and expand dmG p^h{x^ j.) around q 

(23) dmGi3^h{x*m^r) = dmG I3,h{x*m^r) + {r - q)drdmG p^hix^r) 

r=q r=q 

+ ^-^-^d^,d^G^,Ux*m^,) +0{{r- qf) . 

Z r=q 

The remainder term is bounded (this can be checked using the gaussian differentiation 
formula to calculate the third derivative). 

The first term of the expansion is by Proposition as the integral involved in the 
differentiation formula is from qio r. The second term vanishes too as we retrieve the self- 
consistency equation for q by differentiating in r the integral expression for dmGp^h{x*mr) 



drdmG j3^h{x*fn,r , 



r=q 



E^.^ ^, [tanh(/3?7i(r) + h) tanh(/3??2(r) + h)\qu 



0. 



r=q 



> 0. 



r=q 



Therefore to prove (EU, it suffices to find conditions for which dmd'^Gp^h{:i 
Equation ifTTj) is useful to compute 5^G^_ft(x^ ^). From Theorem|3 the matrices Qs and 

Q4 with Pa;. 



I — m 

(2 — m){\ — m) 
2 

(3 — m)(2 — m)(l — m) 



) / and 


IP.?„,.(Q4)/0 


are 






= r) 




,,(^12 = ^923 = 


= r) 






= r) 


x*^^M^2 = 


qsA = r, qis = 


= <!) 



6 



m(l — my 
6 



The reader can check that all missing overlaps qij of the matrices Q3 and Q4 in the above 
events are determined by ultrametricity. For example, if qi2 = r, 523 = r then 513 = r. 
From the probabilities above, one can see that, when applying the derivative dm directly 
to d'^Gfs^hiXm r) s-^d taking the limit m ^ 1~, only the terms coming from the derivative 
of the factor 1 — m do not vanish. Thus, one gets the remaining terms 



(24) 

lim [ d:^dmGf3^h{Xmr 
m—>l~ 



r=q 



[1 - (3^E^* [1 - 2tanh2(/3(7?(g) + h)) + tanh\(3{fi{q) + h))] ) 



[cosh-\P{fj{q) + h))]) 



where we have used the fact that 



r=q 



X*. Hence by the Taylor's expansion H23|l 



and the equation ()24() . if (3 and h are such that 
/?2E,.* [cosh-\(3{fi{q) + h))] 



cosh-^iPz^+h)) > 1, 



we can pick m close enough to 1 and r close enough to q so that the inequality holds. 
This yields the desired sufficient condition for the high-temperature solution not to hold. 
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Appendix A. Topology on M 

The weak, vague and weak-* convergences correspond on the space of probabihty mea- 
sures M as the measures are on a compact of M. Moreover, any sequence is tight. There- 
fore, the weak topology is determined by the weak convergence. 

In studying the functionals on Ai, we are led to consider the topology on induced 
by the {[0, 1], g'{q)dq) -norm on the distribution functions of the elements of Ai where 
g is a strictly increasing function in C^([0, 1]) with g{0) = 0. It turns out that all these 
norms induce topologies on Ai that are equivalent to the weak topology. 

First, we claim that the L^((7'(g)(i(jr)-topology is equivalent to the L^(d(7)-topology on 
the space M.. Clearly, || • < maxgg('(g)|| • On the other hand, the 

following estimate holds for any 5 > 0: 

II • Wmdg) < Jll • \\L\g'iq)dg) + Leb{q G [0, 1] : < g'{q) < 5} 

where Leb stands for the Lebesgue measure. We use the fact that the distribution functions 
are bounded above by 1 and below by to get the second term. As g is strictly increasing, 
we have that, for any e > 0, there exists 5(e) such that Leb{q G [0, 1] : < g'{q) < 6} < e. 
Let be a net of distribution functions on [0, 1] that converges in the {g' {q)dq)-norni. 
To see that also converges in the L^{dq) -norm, it suffices to see that for 6 arbitrary small 
but fixed, one can also make the first term of the r.h.s. of the above estimate arbitrary 
small using the convergence in the {g' (q)dq)-noTni. 

The equivalence with the weak topology is a direct consequence of the fact that the 
L^{dq)-norm metrizes the weak topology on Ai (see 



Appendix B. Gaussian Differentiation Formulas 

The differentiation of expectations of gaussian variables whose covariance depends on 
a parameter is facilitated by the following result which can be seen as an extension of the 
Wick's formula or simply gaussian integration by parts. 

Proposition 16 ([21 OD- Consider a gaussian vector k, = {Ki,i G N) for which the covari- 
ance matrix {cij{t)} depends on a parameter t G [0, 1]. Assume Cij G C"'^([0, 1])). We write 
Kt for the expectation over k. Let <p ■ ^ M m C^(M^) whose derivatives multiplied by 
Q-e\x\ gy,g jjQUfid^d functions for any e > 0. Then 

The proof of the proposition is easy to carry for polynomials (this case is the usual Wick's 
formula). For the general case, we refer to ^ for a proof using the Fourier transform. 
In the case 0(k) = log .^^e^^'^"'' for a set of weight {^a}, the formula becomes 

d 1 „ f e'Pii^a) 

" ITT' r^/ M ^ / ('j.MiT' r / \ , 1 12/ ^^ "^a^ 



(25) ^Mm] = \Y.<o.mtWM+^'\^.)\ 



It is possible to get higher-order derivatives by just applying the above gaussian differ- 
entiation formula successively. As an example, if the covariance Cij depends linearly on 
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two parameters s and t, Cjj = Cij{s,t), then applying the formula ((TB|) twice yields 
(26) dsdiEs^tlHi^)] = ^ X] dsCijdtCijEs,t [^,^^^,^^^,^^^^,^^(|){K)] . 

i,j,k,l 
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